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Abstract 

Most work in game theory assumes that players are perfect reasoners and have common knowl- 
edge of all significant aspects of the game. In earlier work |Halpern and Rego 2006) , we proposed 
a framework for representing and analyzing games with possibly unaware players, and suggested 
a generalization of Nash equilibrium appropriate for games with unaware players that we called 
generalized Nash equilibrium. Here, we use this framework to analyze other solution concepts that 
have been considered in the game-theory literature, with a focus on sequential equilibrium. We also 
provide some insight into the notion of generalized Nash equilibrium by proving that it is closely 
related to the notion of rationalizability when we restrict the analysis to games in normal form and 
no unawareness is involved. 

Keywords: Economic Theory, Foundations of Game Theory, Awareness, Sequential Equilibrium, 
Rationalizability. 

1 INTRODUCTION 

Game theory has proved to be a useful tool in the modeling and analysis of many phenomena involv- 
ing interaction between multiple agents. However, standard models used in game theory implicitly 
assume that agents are perfect reasoners and have common knowledge of all significant aspects of the 
game. There are many situations where these assumptions are not reasonable. In large games, agents 
may not be aware of the other players in the game or all the moves a player can make. Recently, we 



I Halpem and Rego 2006 1 proposed a way of modeling such games. A key feature of this approach is 
the use of an augmented game, which represents what players are aware of at each node of an extensive 
form representation of a game. Since the game is no longer assumed to be common knowledge, each 
augmented game represents the game a player considers possible in some situation and describes how 
he believes each other player's awareness level changes over time, where intuitively the awareness level 
of a player is the set of histories of the game that the player is aware of. 

In games with possibly unaware players, standard solution concepts cannot be applied. For example, 
in a standard game a strategy profile is a Nash equilibrium if each agent's strategy is a best response 
to the other agents' strategies, so each agent i would continue playing his strategy even if i knew what 
strategies the other agents were using. In the presence of unawareness this no longer make sense, since 



the strategies used by other players may involve moves i is unawai^e of. We proposed a generalization 
of Nash equilibrium consisting of a collection of strategies, one for each pair {i, T'), where T' is a game 
that agent i considers to be the true game in some situation. Intuitively, the strategy for a player i at T' 
is the strategy i would play in situations where i believes that the true game is T'. Roughly speaking, 
a generalized strategy profile a, which includes a strategy cjj r' for each pair {i,T'), is a generalized 
Nash equilibrium if cTj^r' is a best response for player i if the true game is T', given the strategies being 
used by the other players in T'. We showed that every game with awareness has a generalized Nash 
equilibrium by associating a game with awareness with a standard game (where agents are aware of all 
moves) and proving that there is a one-to-one correspondence between the generalized Nash equilibria 
of the game with awareness and the Nash equilibria of the standard game. 

Some Nash equilibria seem unreasonable. For example, consider the game shown in Figure [T] One 
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Figure 1 : A simple game. 

Nash equilibrium of this game has A playing down^ and B playing across^. In this equilibrium, B gets 
a payoff of 3, and A get a relatively poor payoff of 1. Intuitively, A plays down because of B's "threat" 
to play across^. But this threat does not appeal" to be so credible. If player B is rational and ever gets 
to move, he will not choose to move across^ since it gives him a lower payoff than playing down^. 
Moreover, if B will play down^ if he gets to move, then A should play across^. 

One standard interpretation of a Nash equilibrium is that a player chooses his strategy at the be- 
ginning of the game, and then does not change it because he has no motivation for doing so (since his 
payoff is no higher when he changes sti^ategies). But this interpretation is suspect in extensive-form 
games when a player makes a move that takes the game off the equilibrium path. It may seem unreason- 
able for a player to then play the move called for by his strategy (even if the strategy is part of a Nash 
equilibrium), as in the case of player B choosing across^ in the example of Figure [T] In other words, 
a threat to blow up the world if I catch you cheating in a game may be part of a Nash equilibrium, and 
does not cause problems if in fact no one cheats, but it hardly seems credible if someone does cheat. 

One way to justify the existence of incredible threats off the equilibrium path in a Nash equilibrium 
is to view the player as choosing a computer program that will play the game for him, and then leaving. 
Since the program is not changed once it is set in motion, threats about moves that will be made at 
information sets off the equilibrium path become more credible. However, in a game with awareness, a 
player cannot write a program to play the whole game at the beginning of the game because, when his 
level of awareness changes, he realizes that there are moves available to him that he was not aware of 
at the beginning of the game. He thus must write a new program that takes this into account. But this 
means we cannot sidestep the problem of incredible threats by appealing to the use of a pre-programmed 
computer to play a strategy. Once we allow a player to change his program, threats that were made 
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credible because the program could not be rewritten become incredible again. Thus, the consideration 
of equilibrium refinements that block incredible threats becomes even more pertinent with awareness Q 

There have been a number of variants of Nash equilibrium proposed in the literature to deal with this 
problem (and others), including perfect equilibrium [Selten 1975 i . proper equilibrium | ,Myerson 1978 ], 
sequential equilibrium [Kreps and Wilson 1982|, and rationalizability MBemheim 1984[ iPearce 19841 . 



to name just a few. Each of these solution concepts involves some notion of best response. Our frame- 
work allows for straightforward generalizations of all these solution concepts. As in our treatment of 
Nash equilibrium, if Ti / we treat player i who considers the true game to be Fi to be a different 
agent from the version of player i who considers r2 to be the true game. Each version of player i best 
responds (in the sense appropriate for that solution concept) given his view of the game. In standard 
games, it has been shown that, in each game, there is a strategy profile satisfying that solution concept. 
Showing that an analogous result holds in games with awareness can be nontrivial. Instead of going 
through the process of generalizing every solution concept, we focus here on sequential equilibrium 
since (a) it is one of the best-known solution concepts for extensive games, (b) the proof that a gen- 
eralized sequential equilibrium exists suggests an interesting generalization of sequential equilibrium 
for standard games, and (c) the techniques used to prove its existence in games with awareness may 
generalize to other solution concepts. 

Sequential equilibrium refines Nash equilibrium (in the sense that every sequential equilibrium is 
a Nash equilibrium) and does not allow solutions such as (down^^, across^). Intuitively, in a sequen- 
tial equilibrium, every player must make a best response at every information set (even if it is reached 
with probability 0). In the game shown in Figure [T] the unique sequential equilibrium has A choosing 
across A and B choosing down^. We propose a generalization of sequential equilibrium to games with 
possibly unaware players, and show that every game with awareness has a generalized sequential equi- 
librium. This turns out to be somewhat more subtle than the corresponding argument for generalized 
Nash equilibrium. Our proof requires us to define a generalization of sequential equilibrium in standard 
games. Roughly speaking, this generalization relaxes the implicit assumption in sequential equilibrium 
that every history in an information set is actually considered possible by the player. We call this notion 
conditional sequential equilibrium. 

Other issues arise when considering sequential equilibrium in games with awareness. For example, 
in a standard game, when a player reaches a history that is not on the equilibrium path, he must believe 
that his opponent made a mistake. However, in games with awareness, a player may become aware of 
her own unawareness and, as a result, switch strategies. In the definition of sequential equilibrium in 
standard games, play off the equilibrium path is dealt with by viewing it as the limit of "small mistakes" 
(i.e., small deviations from the equilibrium strategy). Given that there are alternative ways of dealing 
with mistakes in games with awareness, perhaps other approaches for dealing with off-equilibrium play 
might be more appropriate. While other ways of dealing with mistakes may well prove interesting, 
we would argue that our generalization of sequential equilibrium can be motivated the same way as in 
standard games. Roughly speaking, for us, how a player's awareness level changes over time is not part 
of the equilibrium concept, but is given as part of the description of the game. 

We also provide some insight into the notion of generalized Nash equilibrium by proving that, in a 
precise sense, it is closely related to the notion of rationalizability when we restrict the analysis to games 
in normal form and no unawareness is involved (although the underlying game is no longer common 
knowledge among the players). Roughly speaking, a normal form game can be thought as a one-shot 



'We thank Aviad Heifetz and an anonymous referee for raising some of these issues. 
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extensive game where no player knows the move the others made before they make their own move. 
Intuitively, in standard games, a strategy is rationalizable for a player if it is a best response to some 
reasonable beliefs he might have about the strategies being played by other players, and a strategy is 
part of a Nash equilibrium if it is a best response to the strategies actually played by the other players. 
Since, in games with awareness, the game is not common knowledge, a local strategy for player i in r+ 
is part of a generalized Nash equilibrium if it is a best response to the strategies played by the opponents 
of player i in the games player i believes his opponents consider to be the actual one while moving in 
r+. Note that the line between rationalizability and generalized Nash equilibrium is not sharp. In fact, 
we are essentially able to prove that a strategy is rationalizable in a standard game F iff it is part of 
generalized Nash equilibrium of an appropriate game with awareness whose underlying game is T. 

The rest of this paper is organized as follows. In Section |2l we give the reader the necessary back- 
ground to understand this paper by reviewing our model for games with awareness. In Section[3l we re- 
view the definition of sequential equilibrium for standard games and define its generalization for games 
with awareness. In Section |4j we define the concept of conditional sequential equilibrium for stan- 
dard games, and prove that there is a one-to-one correspondence between the generalized sequential 
equilibria of a game with awareness and the conditional sequential equilibria of the standard game asso- 
ciated with it. In Section m we analyze the connection between rationalizability and generalized Nash 
equilibrium. We conclude in Section |6l Proofs of the theorems can be found in the Appendix. 

2 GAMES WITH AWARENESS 

In this section, we introduce some notation and give some intuition regarding games with awareness. 
We encourage the reader to consult our earlier paper for details. 

Games with awareness are modeled using augmented games. Given a standard extensive-form game 
described by a game tree F, an augmented game r+ based on T augments T by describing each agent's 
awareness level at each node, where player i's awareness level at a node h is essentially the set of runs 
(complete histories) in F that i is aware of at node h. A player's awareness level may change over time, 
as the player becomes aware of more moves. 

Formally, a (finite) extensive game is a tuple F = (iV, M, H, P, fc, {Ti : i € N}, {uj : i £ N}), 
where 

• is a finite set consisting of the players of the game. 

• M is a finite set whose elements are the moves (or actions) available to players (and nature) during 
the game. 

• H isa finite set of finite sequences of moves (elements of M) that is closed under prefixes, so that 
if h G H and h' is a prefix of h, then h' G H. Intuitively, each member of is a history. We 
can identify the nodes in a game tree with the histories in H. Each node n is characterized by the 
sequence of moves needed to reach n. A run in is a terminal history, one that is not a strict prefix 
of any other history in H. Let Z denote the set of runs of H. Let = {m ^ M : h- im) e H} 
(where we use • to denote concatenation of sequences); is the set of moves that can be made 
after history h. 

• P : {H — Z) —>■ N U {c} is a function that assigns to each nonterminal history h a member of 
N U {c}. (We can think of c as representing nature.) If P{h) = i, then player i moves after history 
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h; if P{h) = c, then nature moves after h. Let Hi = {h : P{h) = i} be the set of all histories 
after which player i moves. 



• /c is a function that associates with every history for which P{h) = c a probability measure 
/c(- I h) on M/i- Intuitively, /c(- | h) describes the probability of nature's moves once history h 
is reached. 

• is a partition of Hi with the property that if h and h' are in the same cell of the partition then 
Mh = Mh', i.e., the same set of moves is available for every history in a cell of the partition. 
Intuitively, if h and h' are in the same cell of li, then h and h' are indistinguishable from i's point 
of view; i considers history h' possible if the actual history is h, and vice versa. A cell / G is 
called an {i-)information set. 

• Uj : Z — > R is a payoff function for player i, assigning a real number (i's payoff) to each run of 
the game. 

An augmented game is defined much like an extensive game. The only essential difference is that at 
each nonterminal history we not only determine the player moving but also her awareness level. There 
are also extra moves of nature that intuitively capture players' uncertainty regarding the awareness level 
of their opponents. Formally, given an extensive game F = (A'^, M, if, P, /c, {Xj : i € N}, {ui : i G 
N}), an augmented game based on F is a tuple F+ = (iV+, M+, H+ , P+, /+, {1+ : i G iV+}, {uf : 
i G N+},{Af : i G N+}), where {N+ , M+ , H+ , P+ , f+ , {1+ : i G A^+},{u+ : i G N+}) is a 
standard extensive game with perfect recalJl and Af : Hf — > 2^ describes i's awareness level at each 
history at which he moves. F+ must satisfy some consistency conditions. These conditions basically 
ensure that 

• a player's awareness level depends only on the information she has as captured by her information 
sets; 

• players do not forget histories that they were aware of; and 

• there is common knowledge of (1) what the payoffs are in the underlying game and (2) what the 
information sets are in the underlying game. 

The formal conditions are not needed in this paper, so we omit them here. 

An augmented game describes either the modeler's view of the game or the subjective view of the 
game of one of the players, and includes both moves of the underlying game and moves of nature that 
change awareness. A game with awareness collects all these different views, and describes, in each view, 
what view other players have. Formally, a game with awareness based onT = {N, M, H, P, fc, {2, : 
i G N}, {ui-.ie N}) is a tuple F* = {Q, T"',T), where 

• Q is a. countable set of augmented games based on F, of which one is F™; 

• maps an augmented game € Q and a history h in F+ such that P^{h) = i to a pair (F'^, /), 
where F^ G and / is an i-information set in game F^. 

game with perfect recall is one where, players remember all the actions they have performed and all the information 
sets they have passed through; see lOsborne and Rubinstein 1994 J for the formal definition. 
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Intuitively, T"^ is the game from the point of view of an omniscient modeler. If player i moves at h in 
game r+ € ^ and ^(r+, h) = {T^, I), then is the game that i believes to be the true game when 
the history is h, and / consists of the set of histories in that i currently considers possible. 

The augmented game F"^ and the mapping must satisfy a number of consistency conditions. 
The conditions on the modeler's game ensures that the modeler is aware of all the players and moves 
of the underlying game, and that he understands how nature's moves work in the underlying game T. 
The game can be thought of as a description of "reality"; it describes the effect of moves in the 
underlying game and how players' awareness levels change. The other games in Q describe a player's 
subjective view of the situation. 

There are also ten constraints on the mapping that capture desirable properties of awareness. 
Rather than describing all ten constraints here, we briefly describe a few of them, to give some idea of 
the intuition behind these constraints. Suppose that T{T^,h) = {T^,I) and Af{h) = a|l then the 
following conditions hold. 

CI. {h : h € H^} = a, where h is the subsequence of h consisting of all the moves in h that are also 
in the set of moves M of the underlying game F. 

C2. If h' G H'^ and P^\h') = j, then A^{h') C a and Af^/ n{m:h' ■ (m) £ a} = Mj^,. 

C5. If h' € F+, P^{h') = i, Af{h') = a, then if h and h' are in the same information set of F+, 
then J^(F+, h') = (F^, /), while if /i is a prefix or a suffix of h', then T{T+, h') = {T^ , I') for 
some i-information set /'. 

C8. For all histories h' e /, there exists a prefix h'l of h' such that P^{h'i) = i and !F{T^,h'i) = 
(F', I') iffthere exists a prefix /ii of /i such that P+(/ii) = i and JF(F+, /ii) = (F',/')- Moreover, 
h'l ■ (m) is a prefix of h' iff hi ■ (m) is a prefix of h. 

C9. There exists a history h' £ I such that for every prefix h" • (m) of h', if P^{h") = i G N^' and 
J^(F^, h") = (F', I'), then for all hi G /', hi ■ \m) G H' . 

Suppose that FiT^ , h) = (F'', I). Player i moving at history h in F"*" thinks the actual game is F'^. 
Moreover, i thinks he is in the information set of I of F^. CI guarantees that the set of histories of the 
underlying game player i is aware of is exactly the set of histories of the underlying game that appear 
in F^. C2 states that no player in F^ can be aware of histories not in a. The second part of C2 implies 
that the set of moves available for player j at h' is just the set of moves that player i is aware of that are 
available for j at h in the underlying game. C5 says that player i's subjective view of the game changes 
only if i becomes aware of more moves and is the same at histories in that i cannot distinguish. 

C8 is a consequence of the perfect recall assumption. C8 says that if, at history h, i considers h' 
possible, then for every prefix h'l of h' there is a corresponding prefix of h where i considers himself to 
be playing the same game, and similarly, for every prefix of h there is a prefix of h' where i considers 
himself to be playing the same game. Moreover, i makes the same move at these prefixes. The intuition 
behind condition C9 is that player i knows that player j only make moves that j is aware of. Therefore, 
player i must consider at least one history h' where he beheves that every player j made a move that j 

'As in our earlier paper, we use tlie convention that the components of a (standard or augmented) game F"*" are labeled 
with the same superscript +, so that we have , _ff^, , and so on. 
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was aware of. It follows from conditions on augmented games, CI, C2, and C9 that there is a run going 
through / where every player j makes a move that player i believes that j is aware of. 

It may seem that by making T a function we cannot capture a player's uncertainty about the game 
being played or uncertainty about opponents' unawareness about histories. However, we can capture 
such uncertainty by folding it into nature's initial move in the game the player consider possible while 
moving. It should be clear that this gives a general approach to capturing such uncertainties. 

We identify a standard extensive game F with the game ({r™},r™,^), where (abusing notation 
slightly) r™ = (r, {Ai : i G A^}) and, for all histories h in an i-information set I in F, Ai{h) = H and 
T{Y'^, h) = (r™, I). Thus, all players are aware of all the runs in T, and agree with each other and the 
modeler that the game is F. This is the canonical representation o/F as a game with awareness. 

In |Halpem and Rego 2006 1, we discussed generalizations of games with awareness to include situ- 
ations where players may be aware of their own unawareness and, more generally, games where players 
may not have common knowledge of the underlying game is; for example, players may disagree about 
what the payoffs or the information sets are. With these models, we can capture a situation where, for 
example, player i may think that another player j cannot make a certain a certain move, when in fact 
j can make such a move. For ease of exposition, we do not discuss these generalizations further here. 
However, it is not hard to show that the results of this paper can be extended to them in a straightforward 
way. 

Feinberg 1120041 l2005l also studied games with awareness. Feinberg II2005II gives a definition of ex- 
tended Nash equilibrium in normal-form games. Feinberg II2004I1 deals with extensive-form games and 
defines solution concepts only indirectly, via a syntactic epistemic characterization. His approach lacks 
a more direct semantic framework, which our model provides. Li Il2006al has also provided a model 
of unawareness in extensive games, based on her earlier work on modeling unawareness MLi 2006b [ 
ILi 2006c]l . See |Halpem and Rego 2006 1 for some further discussion of the relation between these ap- 
proaches and ours. 



3 GENERALIZED SEQUENTIAL EQUILIBRIUM 

To explain generalized sequential equilibrium, we first review the notion of sequential equilibrium for 
standard games. 



3.1 SEQUENTIAL EQUILIBRIUM FOR STANDARD GAMES 

Sequential equilibrium is defined with respect to an assessment, a pair (ct, /i) where (5 is a strategy 
profile consisting of behavioral strategies and ^ is a belief system, i.e., a function that determines for 
every information set / a probability /i/ over the histories in /. Intuitively, if I is an information set for 
player i, fij is i's subjective assessment of the relative likelihood of the histories in /. Roughly speaking, 
an assessment is a sequential equilibrium if for all players i, at every i-information set, (a) i chooses 
a best response given the beliefs he has about the histories in that information set and the strategies of 
other players, and (b) i's beliefs are consistent with the strategy profile being played, in the sense that 
they are calculated by conditioning the probability distribution induced by the strategy profile over the 
histories on the information set. 

Note that /i/ is defined even if / is reached with probability 0. Defining consistency at an informa- 
tion set that is reached with probability is somewhat subtle. In that case, intuitively, once information 
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set / is reached player i moving at / must believe the game has been played according to an alter- 
native strategy profile. In a sequential equilibrium, that alternative strategy profile consists of a small 
perturbation of the original assessment where every move is chosen with positive probability. 

Given a strategy profile a, let Pr^ be the probability distribution induced by a over the possible 
histories of the game. Intuitively, Pr^(/i) is the product of the probability of each of the moves in h. For 
simplicity we assume fc > 0, so that if a is such that every player chooses all of his moves with positive 
probability, then for every history h, Pr5^(/i) For any history h of the game, define PiCff{- \ h) 

to be the conditional probability distribution induced by a over the possible histories of the game given 
that the current history is h. Intuitively, 'Pig{h' \ /i) is if /i is not a prefix of h' , is 1 if /i = h' , and is the 
product of the probability of each of the moves in the path from h to h' if /i is a prefix of h' . Formally, 
an assessment {a, fi) is a sequential equilibrium if it satisfies the following properties: 

• Sequential rationality. For every information set / and player i and every behavioral strategy a 
for player i, 

EU,((a,^) |/) >EU, (((<?_„ (j),;u) |/), 
whereEUi(((T,^) | /) =J2heiT,zez t^iWP'^aiz \ h)u^{z). 

• Consistency between belief system and strategy profile. If a consists of completely mixed (behav- 
ior) strategies, that is, ones that assign positive probability to every action at every information 
set, then for every information set / and history h in /, 

Otherwise, there exists a sequence (cr", /i"), n = 1, 2, 3, . . ., of assessments such that a"- consists 
of completely mixed strategies, ((?", /i") is consistent in the above sense, and lim.n^^{a"- , p,"-) = 
{a,p). 

Sequential equilibrium is not a reasonable solution concept for games with awareness for the same 
reason that Nash equilibrium is not a reasonable solution concept for games with awareness; it requires 
that a player be aware of the set of possible strategies available to other players and to him. In order to 
define a generalized notion of sequential equilibrium for games with awareness, we first need to define 
a generahzed notion of assessment for games with awareness. We first need a generalized notion of 
strategy, which we defined in our earlier paper. 

Intuitively, a strategy describes what i will do in every possible situation that can arise. This no 
longer makes sense in games with awareness, since a player no longer understands in advance all the 
possible situations that can arise. For example, player i cannot plan in advance for what will happen 
if he becomes aware of something he is initially unaware of. We solved this problem in our earlier 
paper as follows. Let Gi = {V e G : for some r+ € ^ and /i in r+, = i and J^(r+, h) = 

(r', •)}■ Intuitively, Qi consists of the games that i views as the real game in some history. Rather than 
considering a single strategy in a game F* = (t/jF*",^) with awareness, we considered a collection 
{cTj^r' : r' € ^i} of local strategies. Intuitively, a local strategy crjj' for game F' is the strategy that i 
would use if i were called upon to play and i thought that the true game was F'. Thus, the domain of Uj r' 

''See (Myerson 19911 for a definition of sequential equilibrium in the case nature chooses some of its move with probability 

0. 
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consists of pairs (r+, h) such that T+ e g,h is a history in r+, P+{h) = i, and J='{T+, h) = {V , I). 
Let (r'', I)* = {{V ,h) : J^{T\ h) = {T^,I)y, we call (r'', I)* a generalized information set. 

Definition 3.1: Given a game F* = {Q, F™, ^) with awareness, a local strategy ai^Y' for agent i is a 
function mapping pairs (r+, h) such that /i is a history where i moves in r+ and ^(r+, h) = (F', /) to 
a probability distribution over M^,, the moves available at a history h' € /, such that o"ij'(ri, hi) = 
(Tj^r' 5 ^2 ) if (ri , /ii ) and , /12 ) are in the same generalized information set. A generalized strategy 
profile of r* = {g, r™, J^) is a set of local strategies a = {ai^r ■.ieN,r'£ Qi}. 

The belief system, the second component of the assessment, is a function from information sets / 
to probability distribution over the histories in /. Intuitively, it captures how Ukely each of the histories 
in I is for the player moving at /. For standard games this distribution can be arbitrary, since the player 
considers every history in the information set possible. This is no longer true in games with awareness. It 
is possible that a player is playing game Fi but believes he is playing a different game F2. Furthermore, 
in an augmented game, there may be some histories in an ^-information set that include moves of which 
i is not aware; player i cannot consider these histories possible. To deal with these problems, we define 
/i to be a generalized belief system if it is a function from generalized information sets to a probability 
distribution over the set of histories in the generalized information set that the player considers possible. 

Definition 3.2: A generalized belief system /i is a function that associates each generalized information 
set (F', /)* with a probability distribution fi]-i j over the set {(F', h) : h £ I}. A generalized assessment 
is a pair {a, //), where is a generalized strategy profile and is a generalized belief system. 

We can now define what it means for a generalized assessment {a* , ^u* ) to be a generalized sequen- 
tial equilibrium of a game with awareness. The definition is essentially identical to that of {a, //) being 
a sequential equilibrium; the use of EUj in the definition of sequential rationality is replaced by EUj r'> 
where EUi^r'((o^*) A**) I I) is the conditional expected payoff for i in the game F', given that strategy 
profile a* is used, information set / has been reached, and player i's beliefs about the histories in / are 
described by jj.^, j. We leave the straightforward modifications of the definition to the reader. It is easy 
to see that {a, fi) is a sequential equilibrium of a standard game F iff {a, //) is a (generalized) sequen- 
tial equilibrium of the canonical representation of F as a game with awareness. Thus, our definition of 
generalized sequential equilibrium generalizes the standard definition. 

To better understand the concept of generalized sequential equilibrium concept, consider the game 
shown in Figure |2] Suppose that both players 1 and 2 are aware of all runs of the game, but player 1 
(falsely) believes that player 2 is aware only of the runs not involving L and believes that player 1 is 
aware of these runs as well. Also suppose that player 2 is aware of all of this; that is, player 2's view of 
the game is the same as the modeler's view of the game F*" shown in Figure |2] While moving at node 
1.1, player 1 considers the true game to be identical to the modeler's game except that from player I's 
point of view, while moving at 2.1, player 2 believes the true game is F^'^, shown in Figure[3] 

This game has a unique generalized sequential equilibrium where player 2 chooses r and player 1 
chooses A in F^-^. Believing that player 2 will move r, player 1 best responds by choosing L at node 
1.1. Since player 2 knows all this at node 2.1 in F™, she chooses / at this node. Thus, if players follow 
their equilibrium strategies, the payoff vector is (—10, —1). In this situation, player 2 would be better 
off is she could let player 1 know that she is aware of move L, since then player 1 would play A and both 
players would receive 1. On the other hand, if we slightly modify the game by making U2{{L, I)) = 3, 
then player 2 would benefit from the fact that 1 believes that she is unaware of move L. 
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Figure 2: The modeler's game F"*. 



Mil * 




i'iM (0.-1) 



Figure 3: Player 2's view of the game from point of view of player 1. 
3.2 EXISTENCE OF GENERALIZED EQUILIBRIA 

We now want to show that every game with awareness T* has at least one generalized sequential equi- 
librium. To prove that a game with awareness F* has a generalized Nash equilibrium, we constructed a 
standard game F*^ with perfect recall and showed that there exists a one-to-one correspondence between 
the set of generalized Nash equilibrium of F* and the set of Nash equilibrium of F'^. Intuitively, F^ is 
constructed by essentially "gluing together" all the games F' G Q, except that only histories in F' that 
can actually be played according to the players' awareness level are considered. 

More formally, given a game F* = {Q,T^,J^) with awareness, let be a probability on Q that 
assigns each game in Q positive probability. (Here is where we use the fact that Q is countable.) For 
each F' G Q, let [H^' \ = {h £ H^' : for every prefix hi ■ (m) of h, if P'ihi) = i £ N and 
jF(r', hi) = (F", /), then for all h2 G /, /i2 • (m) G H"}. The histories in [H^' \ are the ones that can 
actually be played according to the players' awareness levels. 

Let F*^ be the standard game such that 
. iV- = {(i,F'):F'Gg,}; 

• M"" = g Ur'eg where [M^'j is the set of moves that occur in [iJ^'j; 

. H'' = {)u{{T')-h:r' eg,helH'''\}; 
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• =c, and 



(i,r^') if = i e iVand 

p''{{T^)-h') = { ^(^^/l') = (^^^•), 

z if P^{h') = c; 



rAT'\{)) = v{T') and f-{.\{T^) • h') = f^{-\h') if P^{h') = c; 

Z^Yi is a partition of H'^y' where two histories (F^) • and (F^) • we, in the same information 
set (r', /)* iff (r^, h^) and (r^, /i^) are in the same generahzed information set (r', /)*; 



,r'Ui ifr'^/r'. 



Unfortunately, while it is the case that there is a 1-1 correspondence between the Nash equilibria 
of and the generalized Nash equilibria of F*, , this correspondence breaks down for sequential 
equilibria. To see why consider the modified version of prisoner's dilemma F^, described in Figure HI 




Figure 4: F^: modified prisoner's dilemma. 

Besides being able to cooperate {Ca) or defect {Da), player A who moves first has also the option 
of escaping {Ea)- If player A escapes, then the game is over; if player A cooperates or defects, then 
player B may also cooperate (Cb) or defect {Db)- Suppose further that in the modeler's game, 

• both A and B are aware of all histories of F*'; 

• with probability p, A believes that B is unaware of the extra move Ea, and with probability 1—p, 
A believes B is aware of all histories; 

• if ^ believes B is unaware of Ea, then A believes that B believes that it is common knowledge 
that the game being played contains all histories but Ea', 

• if j4 believes B is aware of Ea, then A believes that B believes that there is common knowledge 
that the game being played is F^; 
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• B believes that it is common knowledge that the game being played is TP. 



We need four augmented games to model this situation: 

• r™ is the game from the modeler's point of view; 

• is the game from A's point of view when she is called to move in the modeler's game; 

• is the game from B's point of view when he is called to move in game after nature 
chooses he is unaware of Ea and is also the game from A's point of view when she is called to 
move in F^-^; and 

• r^-^ is the game from B's point of view when he is called to move in game after nature 
chooses aware^; F^'^ is also the game from B's point of view when he is called to move at F"^ 
and the game from A's point of view when she is called to move in F^-^. 

Although F™ and F^-^ have the same game tree as F^', they are different augmented games, since the 
^ function is defined differently at histories in these games. For example, ^(F*", ( )) = (F"^, {unawares,awareB] 
(F^-^, ( )) = J^(F^-^, ( )). For this reason, we use different labels for the nodes of theses games. Let 
A.3 and B.2 (resp., A.2 and B.2) be the labels of the nodes in game F™ (resp., F^'^) corresponding to 
A and B in F^, respectively. F"^ and F^-^ are shown in Figures [5] and [6l respectively^ 

• In the modeler's game F™, A believes she is playing game F"^, and B believes he is playing game 

p_B.2 

• In game F^, nature chooses move unaware b with probability p and aware^ with probability 1—p. 
Then A moves and believes she is playing F"^. At node BA, B believes he is playing F^'^, and 
at node B.2, B believes he is playing F^-^. 

• In game F^-^, A and B both believe that the game is F^-^. 

• In game F^'^, A and B both believe that the game is F^'^. 



The game is the result of pasting together F"^, F^, F^-^, and F^'^. There are 5 players: 
(^,F^), (A,F^-i), (^,F^-2), (B,F^ i), and {B,T^-^). {A,T^-^) and {B,T^-^) are playing stan- 
dard prisoner's dilemma and therefore both should defect with probability 1; {B,T^-^) must believe 
he is in the history where (yl, F^'^) defected with probability 1. {A,T^) and (A, F^'^) choose the 
extra move Ea with probability 1, since it gives A a payoff of 5. The subtlety arises in the beliefs 
of (i?,F^-^) in the generalized information set {T^'"^ , {Ca, Da})* , since this generalized informa- 
tion set is reached with probability zero. Note that {T^-'^ , {Ca, Da})* = {{T"',Ca), {T"',Da), 
(F^,awareB,C^), (F^, aware^, I^a), (^^''^,Ca), {T^-'^,Da)}- By the definition of sequential equi- 
librium, player (S,F^'^) will have to consider a sequence of strategies where all these histories ai^e 
assigned positive probability. Although in general this is not a problem, note that {B, F^'^) is meant to 
represent the type of player B that considers only histories in game F^-^ possible. Thus, intuitively, he 
should assign positive probability only to the histories {(F^'^, Ca), {^^'^ , Da)}- 

^We abuse notation and use the same label for nodes in different augmented games that are in the same generalized 
information set. For example, A.3 is a label at both F™ and F'*. 
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Figure 5: T^. 




Figure 6: T^ ^ 

To see how this leads to a problem, first note that there is a sequential equiUbrium of where 

(i?,r^'^) believes with probability 1 that the true history is (F , aware Ca), (A,r^-2) chooses Ea 
with probability 1, and {B, T^-^) chooses Cb with probability 1. It is rational for {B, F^-^) to choose 
Cb because (i?, T^-^) assigns probability 1 to the first move of nature in be T"^. Since his utility is 
for every run in whose first move is V^, his expected utility is no matter what move he makes at 
the generalized information set, given his beliefs. 

There is no reasonable definition of generalized sequential equilibrium corresponding to this se- 
quential equilibrium of . Player B while moving at node B.2 would never cooperate, since this is a 
strictly dominated strategy for him in the game that he considers to be the actual game, namely F^-^. 

The problem is that there is nothing in the definition of sequential equilibrium that guarantees that 
the belief system of a sequential equilibrium in F^ assigns probability zero to histories that players 
are unaware of in the game F* with awareness. We want to define a modified notion of sequential 
equilibrium for standard games that guarantees that the behef system in associates each information 
set with a probability distribution over a pre-specified subset of the histories in the information, which 
consists only of the histories in the information set player i actually considers possible. In this example, 
the pre-specified subset would be {(F-^-^, Ca), {T^-'^,Da)}. 

4 CONDITIONAL SEQUENTIAL EQUILIBRIUM 

In the standard definition of sequential equilibrium for extensive games, it is implicitly assumed that 
every player considers all histories in his information set possible. This is evident from the fact that if a 
strategy profile that is part of a sequential equilibrium assigns positive probability to every move, then 
by the consistency requirement the belief system also assigns positive probability to every history of 
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every information set of the game. Therefore, this notion of equiUbrium is not strong enough to capture 
situations where a player is certain that some histories in his information set will not occur. The notion 
of conditional sequential equilibrium, which we now define, is able to deal with such situations. It gen- 
eralizes sequential equilibrium: in a game where every player considers every history in his information 
set possible, the set of conditional sequential equilibria and the set of sequential equilibria coincide. 

Given a standard extensive game F, define a possibility system /C on F to be a function that deter- 
mines for every information set / a nonempty subset of / consisting of the histories in / that the player 
moving at / considers possible. We assume that JC is common knowledge among players of the game, 
so that every player understands what histories are considered possible by everyone else in the game. If 
/ is an i-information set, intuitively i should be indifferent among all runs that go through histories in 
I — K,{I), since i believes that those runs will not occur and every other player knows that. Thus, for a 
given r, a possibility system /C must satisfy the following requirement: if z and z' are two runs going 
through histories in 7 — /C(/) and 7 is an i-information set, then Ui{z) = Ui{z'). 

Given a pair (F, JC), a fC-assessment is a pair {a, /x), where a is a strategy profile of F, and /x is a 
restricted belief system, i.e., a function that determines for every information set / of F a probability 
fii over the histories in /C(/). Intuitively, if I is an information set for player i, jij is i's subjective 
assessment of the relative likelihood of the histories player i considers possible while moving at /, 
namely K.{I). As in the definition of sequential equilibrium, a A^-assessment (a, ii) is a conditional 
sequential equilibrium with respect to JC if (a) at every information set where a player moves he chooses 
a best response given the beliefs he has about the histories that he considers possible in that information 
set and the strategies of other players, and (b) his restricted beliefs must be consistent with the strategy 
profile being played and the possibility system, in the sense that they are calculated by conditioning 
the probability distribution induced by the strategy profile over the histories considered possible on 
the information set. Formally, the definition of {a, fi) being a conditional sequential equilibrium is 
identical to that of sequential equilibrium, except that the summation in the definition of EUj {a, ji) \ I) 
and ni{h) is taken over histories in /C(/) rather than histories in I. It is immediate that if K.{I) = I for 
every information set / of the game, then the set of conditional sequential equilibria with respect to /C 
coincides with the set of sequential equilibria. The next theorem shows that set of conditional sequential 
equilibria for a large class of extensive games that includes is nonempty. 

Theorem 4.1: Let F be an extensive game with perfect recall and countably many players such that 
(a) each player has only finitely many pure strategies and (b) each player's payoff depends only on the 
strategy of finitely many other players. Let /C be an arbitrary possibility system. Then there exists at 
least one K-assessment that is a conditional sequential equilibrium ofV with respect to JC. 

We now prove that every game of awareness has a generalized sequential equilibrium by defining a 
possibihty system JC on and showing that there is a one-to-one correspondence between the set of 
conditional sequential equilibria of with respect to JC and the set of generalized sequential equilibria 
of F*. 

Theorem 4.2: For all probability measures v on Q, ifv gives positive probability to all games in Q, and 
/C((F',/)*) = {(F',/i) : h G 1} for every information set (F',/)* ofV^, then {a',p') is a generalized 
sequential equilibrium ofV* iff {ff,p) is a conditional sequential equilibrium ofV^ with respect to JC, 
where ai^Y'{(P^) • h') = a'^ r'(F'^, h') and /Xp/ j = /x^p',/)*- 
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Since satisfies all the conditions of Theorem 14.11 it easily follows from Theorems 14.11 and 14.21 
that every game with awareness has at least one generalized sequential equilibrium. 

Although it is not true that every conditional sequential equilibrium is also a sequential equilibrium 
of an arbitrary game, the next theorem shows there is a close connection between these notions of 
equilibrium. If {a, fi) is a conditional sequential equilibrium with respect to some possibility system }C, 
then there exists a belief system fi' such that {a, fi') is a sequential equilibrium. 

Theorem 4.3: For every extensive game T with countably many players where each player has finitely 
many pure strategies and for every possibility system KL, if {(7, is a conditional sequential equilibrium 
ofV with respect to IC, then there exists a belief system fi' such that {a, n') is a sequential equilibrium 
ofV. 

5 RATIONALIZABILITY AND GENERALIZED NASH EQUILIBRIUM 

In this section, we analyze the relationship between the notions of rationalizability and generalized Nash 
equilibrium, providing some more intuition about the latter. 

The usual justification for Nash equilibrium is that a player's strategy must be a best response to 
the strategies selected by other players in the equilibrium, because he can deduce what those strategies 
are. However, in most strategic situations, it is not the case that a player can deduce the strategies 
used by other players. Since every player tries to maximize his expected payoff and this is common 
knowledge, the best that a player can hope to do is to deduce a set of reasonable strategies for the 
other players. Here, we take a "reasonable strategy" to be a best response to some reasonable beliefs a 
player might hold about the strategy profile being played. This is the intuition that the rationalizability 
solution concept tries to capture. Even though a notion of rationalizability for extensive-form games 
was proposed by Pearce |1984|, rationalizability is more widely applied in normal-form games. In 
this section, we explore the relationship between rationalizability and generalized Nash equilibrium in 
games with awareness where in the underlying game each player moves only once, and these moves are 
made simultaneously (or, equivalently, a player does not know the moves made by other players before 
making his own move). We show that, given an underlying game F satisfying this requirement, a pure 
strategy profile contains only rationalizable strategies iff it is the strategy profile used by the players 
in the modeler's game in some (pure) generalized Nash equilibrium of a game F* with awareness. If 
we think of rationalizability as characterizing "best response to your beliefs" and Nash equilibrium 
characterizing "best response to what is actually played", then this result shows that in the framework 
of games with awareness, since the game is not common knowledge, the line between these two notions 
is somewhat blurred. 

We start by reviewing the notion of rationalizability for standard normal-form games. Let Ci be the 
set of available pure strategies for player i; C = ^i^NCi is thus the set of pure strategy profiles. Let 
A(M) denote the set of all probability distributions on M. Suppose that each player i is rational and is 
commonly known to choose a strategy from a subset Vi of Ci. Let V^i = Xj^iVi and 

B{V_i) = {ar5rmaXs^gc,EUi((si,7r(D_i))) : 
for some vr E A(D_j)}; 

that is, B{V^i) consists of the strategies in Ci that are best responses to some belief that player i could 
have about the strategies other players are using. 
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The set S = XieNSi of correlated rationalizable strategies is characterized by the following two 
properties: (a) for all i £ N, Si CI B{S-i) and (b) S is the largest set satisfying condition (a), in the 
sense that, for every set of strategy profiles V satisfying (a), we have that D C 5. It is not hard to show 
that for everyplayer i, Si = B{S-i). A strategy Si G Si is called a correlated rationalizable strategy 
for player 

It turns out that we can construct S by the following iterative procedure. Let = Ci for all i £ N. 
Define Cj = B{C^Z^^) for j > 1. Since there are finitely many strategies it is easy to see that there exists 
a finite k such that Cl = for all j > k. It can be shown that Si = linij^oo Cl = Cf . It is also easy 
to see that if (T is a (behavioral) Nash equilibrium, then every pure strategy that is played with positive 
probability according to a is rationalizable (where the probability with which a pure strategy is played 
according to a is the product of the probability of each of its moves according to a). 

We now explore the relationship between rationalizability in an underlying game T in normal-form 
and generalized Nash equilibrium in a special class of games with awareness based on T. Given a 
standard game F and a pure strategy profile s consisting of rationalizable strategies, we define a game 
with awareness T*{s) = {Q, r"^,T) such that (a) there exists a generalized Nash equilibrium of r*(s), 
where Sj is the strategy followed by player i in F™, and (b) every local strategy in every pure generalized 
Nash equilibrium of F* (s) is rationalizable in F. To understand the intuition behind the construction, 
note that if is a pure correlated rationalizable strategy of player i in F, then Si must be a best response 
to some probability distribution vr*' over the set S-i of pure correlated rationalizable strategies of i's 
opponents. The idea will be to include a game F*' in Q that captures the beliefs that make Si a best 
response. Let s ^, . . . , s*" be the strategy profiles in S-i that get positive probability according to tt''\ 
(There are only finitely many, since 5_i consists of only pure strategies.) Let F'** be the game where 
nature initially makes one of m moves, say ci, . . . , (one corresponding to each strategy that gets 
positive probability according to tt^'), where the probability of move cj is 7r'**(s^). After nature's 
choice a copy of F is played. All the histories in F*' in which player i is about to move are in the same 
information set of player i; that is, player i does not know nature's move. However, all the other players 
know nature's move. Finally, all players are aware of all runs of F at every history in F*'. Note that if h 
is a history where player i thinks game F*' is the actual game, and believes that other players will play 

after nature's move cj, then player i believes that Sj is a best response at h. 

Given a pure strategy profile s of the game F, let F*(s) = {Q, F™, J^) be the following game with 
awareness: 

• F™ = (F, {Ai : i G N}), where for every player i and every history h G H^^, Ai{h) = H (the 
set of all histories in F); 

. g = {T^}[j{T< ■.s[eSi,ieN}- 

• for an augmented game in F+ G ((/ — {F™}) and a history h of F"*" of the form (s'_j) • h' , 

- if P^{h) = i, then T{T^ , h) = (F+, /) where / is the information set containing h; 

^From now on, we use s = (si, . . . , s„) to denote pure strategy profiles, and will continue to use a for possibly nonpure 
strategy profiles. 

^In the literature, it is often assumed that each player chooses his strategy independently of the others and that this is 
common knowledge. If we make this assumption, we get a somewhat stronger solution concept (at least, 'if\N\ > 3), which 
we call uncorrelated rationalizability. Essentially the same results as we prove here for correlated rationalizability hold for 
uncorrelated rationalizability; we omit further details here. 
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- if P"*" (h) = j £ N — {i} and Sj is the strategy of player j specified by s'_^, then T{T~^ , h) = 
{T^i , I), wliere / is tiie unique j-information set in game T^J ; 

• for /i e Hjl^, jr(r™, h) = (r*% /), where / is the unique i-information set in game 

The intuition is that if s is a strategy profile such that, for all i £ N, Si is a. rationalizable strategy 
for player i in F, then at the (unique) i-information set of F*", i considers the actual game to be r'^\ 
For this particular game with awareness, there exists a generalized Nash equilibrium where the strategy 
for each player i in the modeler's game is Sj. Conversely, only rationalizable strategies are used in 
any pure generalized Nash equilibrium of F*(s). There is only one small problem with this intuition: 
strategies in F and local strategies for augmented games in F*(s) are defined over different objects. 
The former are defined over information sets of the underlying game F and the latter are defined over 
generalized information sets of F*(s). Fortunately, this problem is easy to deal with: we can identify a 
local strategy in F*(s) with a strategy in F in the obvious way. By definition of F*(s), for every player 
i and augmented game F' E Qi, the domain of the local strategy (Tj^r' consists of a unique generalized 
information set. We denote this information set by /j p'- For each local strategy iTj r' of F*(s), we 
associate the strategy oij p/ in the underlying game F such that (Tj r'(-^i,r') = ^i,r'(^)' where / is the 
unique z-information set in F. 

The following theorem summarizes the relationship between coiTclated rationalizable strategies in 
F and generalized Nash equilibrium of games with awareness. 



Theorem 5.1: If T is a standard normal-form game and s is a (pure) strategy profile such that for all 
i £ N, Si is a correlated rationalizable strategy of player i in T, then 

(i) there is a (pure) generalized Nash equilibrium s* ofT*{s) such that for every player i, s^ps^ = Sj/ 

(ii) for every (pure) generalized Nash equilibrium s* ofT*(s),for every local strategy s*Yifor every 
player i in s*, the strategy s* p/ is correlated rationalizable for player i in F. 

Note that Theorem l5.1l does not imply that for a fixed game with awareness, (pure) generalized Nash 
equilibrium and generalized rationalizability coincide. These notions aie incomparable for standard ex- 
tensive games (cf. [ Battigalli 1997tlPearce 19841 ). so the corresponding generalized notions are incom- 



parable when applied to the canonical representation of a standard game as a game with awareness. If we 
restrict the underlying game to be in normal form, it can be shown that, just as in standard games, every 
strategy in a pure generalized Nash equilibrium is (generalized) rationalizable. Since rationalizability 
is usually defined for pure strategies in the literature |Myerson 1991 ; IQsbome and Rubinstein 19941 . 



we focused on that case here. But it is not hard to show that an analogue of Theorem 15 . 1 1 holds for 
behavioral rationalizable strategies as well. 

Moving up a level, we might ask more generally for the appropriate interpretation of Nash equilib- 
rium in games with awareness. In standard games with a unique Nash equilibrium, we could perhaps 
argue that rational players will play their component of the equilibrium, since they can compute it and 
realize that it is the only stable strategy. In games with several Nash equilibria, perhaps one can be 
singled out as most salient, or some can be eliminated by using refinements of Nash equilibria. 

To some extent, these considerations apply in games with awareness as well. If there is a unique 
generalized Nash equilibrium, although a player cannot necessarily compute the whole equilibrium (for 
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example, if it involves moves that he is not aware of), he can compute that part of the equilibrium that 
is within the scope of his awareness. Thus, this argument for playing a Nash equilibrium lifts from 
standard games to games with awareness. However, other arguments do not lift so well. For example, in 
standard games, one argument for Nash equilibrium is that, over time, players will learn to play a Nash 
equilibrium, for example, by playing a best response to their current beliefs. (However, this is not true 
in general UNachbar 19971 iNachbar 20051 . This argument will not work in the presence of awareness, 
since playing the game repeatedly can make players aware of moves or of other players awareness, and 
thus effectively change the game altogether. 

Another way of interpreting Nash equilibrium in standard games is in terms of evolutionary game 
theory. This approach works with awareness as well. Suppose that we have populations consisting 
of each awareness type of each player, and that at each time step we draw without replacement one 
individual of each of these populations and let them play the game once. If the sample individuals are 
playing an equilibrium strategy, they do not have incentive to deviate unilaterally given their beliefs that 
the other players will continue to follow the equilibrium strategies. 



6 CONCLUSIONS 

In this paper, we further developed the framework of games with awareness by analyzing how to gener- 
alize sequential equilibrium to such games. Other solution concepts can be generalized in a similar way. 
Although we have not checked all the details for all solution concepts, we believe that techniques like 
those used in our earlier paper to prove existence of generalized Nash equilibrium and ones similar to 
those used in this paper for generalized sequential equilibrium will be useful for proving the existence 
of other generalized solution concepts. For example, consider the notion of (trembling hand) perfect 
equilibrium [Selte n 19751 . in normal-form games. A strategy profile <? is a perfect equilibrium if there 
exists some sequence of strategies (ct'^)^q, each assigning positive probability to every available move, 
that converges pointwise to a such that for each player i, the strategy cij is a best response to for all 
k. The definition of generalized perfect equilibrium in games with awareness is the same as in standard 
games, except that we use generalized strategies rather than strategies, and require that for every local 
strategy dj^r' of every player i, ai^r' is a best response to a'^^- p,^ in game F' for all k. To prove that 
every game with awareness in normal form has a generalized perfect equilibrium, we prove an analogue 



of Theorem 3.1(b) in |Halpem and Rego 2006 1, giving a correspondence between the set of general- 
ized perfect equilibria of F* and the set of perfect equilibria of F*^. The existence of a generalized 
perfect equilibrium follows from the existence of a perfect equilibrium in V^; the existence of a perfect 
equilibrium in follows from Lemma lAT2l 

In our earlier work, we showed that our definitions could be extended in a straightforward way to 
games with awareness of unawareness; that is, games where one player might be aware that there are 
moves that another player (or even she herself) might be able to make, although she is not aware of 
what they are. Such awareness of unawareness can be quite relevant in practice. We captured the fact 
that player i is aware that, at a node h in the game tree, there is a move that j can make she (i) is not 
aware of was by having i's subjective representation of the game include a "virtual" move for j at node 
h. Since i does not understand perfectly what can happen after this move, the payoffs associated with 
runs that follow a virtual move represent what player i believes will happen if this run is played and may 
bear no relationship to the actual payoffs in the underlying game. We showed that a generalized Nash 
equilibrium exists in games with awareness of unawareness. It is straightforward to define generalized 
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sequential equilibrium for those games and to prove its existence using the techniques of this paper; we 
leave details to the reader. 

We have focused here on generalizing solution concepts that have proved useful in standard games, 
where there is no lack of awareness. Introducing awareness allows us to consider other solution con- 
cepts. For example, Ozbay II2007II proposes an approach where a player's beliefs about the probability 
of revealed moves of nature, that the player was initially unaware of, are formed as part of the equilib- 
rium definition. We hope to explore the issue of which solution concepts are most appropriate in games 
with awareness in future work. 
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A PROOF OF THEOREMS 

A.l PROOF OF THEOREMS iUHIl AND |43] 

Theorem 14. It Let T be an extensive game with perfect recall and countably many players such that 
(a) each player has only finitely many pure strategies and (b) each player's payoff depends only on the 
strategy of finitely many other players. Let JC be an arbitrary possibility system. Then there exists at 
least one IC-assessment that is a conditional sequential equilibrium ofV with respect to K,. 

Proof: We use the same ideas that are used to prove existence of standard sequential equilibrium, 
following closely the presentation in |Myerson 1991 1. The proof goes as follows. Given F, let rj\/ 



be the multiagent representation of V in normal form. We prove (Lemma lA. II ) that for every perfect 
equilibrium o" of Fa/ and every possibility system K, there exists a restricted belief system ^ such that 
(fj, //) is a conditional sequential equilibrium of T with respect to K,. Then we show (Lemma [A.2l ) that 
for r satisfying the hypothesis of the theorem, F m has at least one perfect equilibrium. 

We now review the relevant definitions. A normal-form game is a tuple {N, Xi^j^id, {ui : i S N}), 
where N is the set of players of the game, Ci is the collection of pure strategies available for player i in 
the game, and Ui is a payoff function that determines for each strategy profile in Xi^^Ci the payoff for 
player i. 

Given a standard extensive-form game F = {N, M, H, P, fc, {Ti : i G N},{ui : i G N}), let 
S* = UjgArXj. Intuitively, we associate with each i-information set / G a temporary player that has 
M(I) as its set possible strategies; S* is just the set of all temporary players in F. For each temporary 
player / we associate a payoff function vj : X7g5*M(/) — > R such that if each temporary player 
/ chooses action aj, and a is the pure strategy profile for F such that for every i G N and I £ Ti, 
(Ti{I) = aj, then vi{xj^s*aj) = Ui{(T). The multiagent representation for F in normal form is the 
tuple (5*,x,65*M(/),{^/ 

Given any countable set B, let A(i3) be the set of all probability measures over B, and let A'^(i?) 
be the set of all probability measures over B whose support is all of B. Given a game in normal form 

F = (A^, Xi(zNCi,{ui : i G N}), a mixed strategy profile a G XjgivA(Ci) is a perfect equilibrium 
of F iff there exists a sequence such that (a) G XjgArA'^(Cj) for k > 1, (b) cr'^ converges 

pointwise to a, and (c) G ar5max^.gA(Ci)EUj((T^j, Tj) for all i £ N. 

The following lemmas are analogues of Theorems 5.1 and 5.2 in [ Myerson 199 1[ . 



Lemma A.l: IfTM is a multiagent representation ofV in normal form, then for every perfect equilib- 
rium aofVM and every possibility system K,, there exists a restricted belief system fi such that {a, fi) is 
a conditional sequential equilibrium ofV with respect to K,. 
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Proof: The proof is almost identical to that of Theorem 5.1 in |Myerson 1991 1. We focus on the neces- 
sary changes, leaving the task of verifying that the rest of the proof goes without change to the reader. 
Let ((t'^)^x ^ ^ieS*^{M{I)) be a sequence of behavioral strategy profiles satisfying conditions (a), 
(b), and (c) of the definition of perfect equilibrium. For each k, define a belief system p'^ such that, for 
each information set /, fi^{I) is the probability over histories in JC{I) defined as 



If I is the set all information sets in Tm, for each k, p'' : I —>■ [0, 1]. Thus, fi^ € [0, 1]-^; and, by 
Tychonoff 's Theorem, [0, 1]-^ is compact. Thus, there must be a convergent subsequence of fi^ , p^ , . . .. 
Suppose that this subsequence converges to fi. It is easy to see that jj, is consistent with a and JC. 

Let Z{I) denote the set of runs that do not contain any prefix in /. Let / be an arbitrary i-information 
set of V^. When agent I G S* uses the randomized strategy pj € A(M(/)) against the strategies 
specified by for all other agents, his expected payoff is 

EVi{a'Lj,pi) = Y, Pr {h)E\Ji{a'lj,pj\h)+ J] Pr {z)ui{z). 

Note that for /i G / or /i G Z{I), Pij-^fe pj){h) = Pr^k{h), since this probability is independent of the 

strategy used by player /. Also note that for all /i G / — /C(/), E\J j{a^j, pi \ h) is independent of pj. 
Thus, 

EViiati^pi) 

= E ^Ah)E\]i{ati,pi\h)+ J2 P^iz)u^{z) + C 

/iG/C(/) z£Z(I) 

= ( l^){h)E\],{a'_,,pi\h)){ PjW)+^"' 
hmK.iI) heK{I) °" 

where C and C" are two constants independent of pj. 

The rest of the proof proceeds just as the proof of Theorem 5.1 in [ Myerson 19911 ; we omit details 
here. | 



Lemma A.2: IfT is an extensive-form game with perfect recall such that (a) there are at most countably 
many players, (b) each player has only finitely many pure strategies, and (c) the payoff of each player 
depends only on the strategy of finitely many other players, then T m has at least one perfect equilibrium. 



Proof: The proof is almost identical to that of Theorem 5.2 in |Myerson 1991 1. Again, we focus on the 



necessary changes, leaving it to the reader to verify that the rest of the proof goes without change. We 
need to modify some of the arguments since Tm is not a finite game; since it may contain countably 
many players. First, by the same argument used to prove that has at least one Nash equilibrium in our 



earlier work |Halpem and Rego 2006 1, we have that for any F satisfying the hypothesis of the lemma, 
Tm has at least one Nash equilibrium. 

Let Ci be the set of pure strategies available for player i in Tm- By Tychonoff's Theorem 
Xjgiv[0, 1]''' is compact. Since XjgjvA(Cj) is a closed subset of Xjgiv[0, 1]"^% it is also compact. All 
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the remaining steps of the proof of Theorem 5.2 in |Myerson 1991 1 apply here without change; we omit 
the details. | 



The proof of Theorem 14. 1 1 follows immediately from Lemmas [A. 1 1 and |AT2l | 

Theorem l4.2t For all probability measures v on Q, ifu gives positive probability to all games in Q, and 
/C((r', /)*) = {(r', /i) : h € 1} for every information set (F', /)* ofV^, then (<?', fi') is a generalized 
sequential equilibrium ofV* iff {a, fi) is a conditional sequential equilibrium ofT^ with respect to JC, 
where ai^r'{{r^) • h') = a[ r'(r'*, h') and ^ = ^(r',/)*- 

Proof: Let Pr^ be the probability distribution over the histories in induced by the strategy profile 
a and For a history h of the game, define Pr|i(- | h) to be the conditional probability distribution 
induced by ff and over the possible histories of the game given that the current history is h. Similarly, 
let Pr^/ be the probability distribution over the histories in P'^ S ^ induced by the generalized strategy 
profile a' and fl.\ Note that if Pr^,(/i') > 0, then h' G IH^\. Thus, (P'^) • h' G . 

For all strategy profiles a and generalized strategy profiles a' , if a[ p/(P'', h') = cTj^r'((r'^) • h'), 
then it is easy to see that for all h' G H'^ such that Pr|i,(/i') > 0, we have that Pr^((P'') • h') = 
u{T^) Pr^/(/i'). And since z/ is a probability measure such that u{T^) > for all P'* G Q, we have that 
Pr^((P'*) ■h')>0 iff Pr^,(/i') > 0. It is also easy to see that for all /i' / ( ) and all h" G such that 
Pr^,(/i" I h') > 0, Pr^((P'') • h" I h') = Pi^ih" I h'). 

Suppose that {a, jj.) is a conditional sequential equilibrium of with respect to JC. We first prove 
that (ct',/x') satisfies generalized sequential rationality. Suppose, by way of contradiction, that it does 
not. Thus, there exists a player i, a generalized i-information set (r+,/)*, and a local strategy s' for 
player i in P+ such that 

E E l^r+,iih)FT{z I h)ut{z) < E E /^r+,/W (z \ h)ut{z). 

heizez+ " heizez+ '^''-(^,T')''' > 

Define s to be a strategy for player {i,T^) in P'^ such that s{{T^) ■ h') = s'{T^,h'). Using the 
observation in the previous paragraph and the fact that j = ;U^r+,/)* ^^id /C((P+, /)*) = {(r"*", h) : 
/i G /}, it follows that 

E E l^{r+Mh)FT{{r+).z\h)ut{z) 

{r+,h)eK{{r+,i)*) zelz+\ " 

< E E ^(r+,/)* W Pr ,((r+) • z I h)ut{z). 

(r+,/i>G/c((r+,/>*) z&[z+\ (<^-(i,r')'*) 

(1) 

By definition of nj'p+, = u\^+{{T+) , z). Replacing uj{z) by uJ'p+((P+), z) in ©, it follows 

that {a, fi) does not satisfy sequential rationality in V^, a contradiction. So, (<?', /u') satisfies generaUzed 
sequential rationality. It remains to show that fi' is consistent with a'. 

Suppose that, for every generalized information set (P+,/)*, X^he/ P^^' (^) > 0- definition 
of /C and the fact that for all h' G H", Pr^((P+) ■ h') > iff Prt,(/i') > 0, we have that for every 
information set (P+,/)* of P'", 

^ Pr((P+) • /i) > 0. 

(r+,h)GK:((r+,/>*) " 
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Thus, by consistency of /i, B, and /C, it follows that for every information set (r+, I)* of and every 

h € /C((r+,I)*), we have 

Smce ^I'^+ j = fi{r+,i)*, /C((r', /)*) = {{V, h) : h e I}, and for all h' e such that Pr^,(/i') > 0, 
we have that Pr^((r'^) • h') = u{T^) Pr^, (/i'), it is easy to see that for every generalized information 
set (r+, /)* and every h e I, 

Thus, jj,' is consistent with a'. 

Finally, suppose that there exists a generalized information set (r+, I)* such that J2hei ^^^'W — 
0. By definition of IC and the fact that for all h' e H", Pr^((r+) • h') > iff Prt, {h') > 0, we have that 
J2{r+ h>GAC((r+ /)*) ■ h) = 0. Thus, by the consistency of /i, a, and /C, there exists a sequence 

of /C-assessments ((t",/x") such that <?" consists of completely mixed strategies, fi^ is consistent with 
ct" and /C, and (ct", /x") converges pointwise to {a, fi). 

Define a sequence of /C-assessments (t",i/") such that 1/^/ j = ^i^-p' i)* ^^'^ '^j'r'ii^^) ' ~ 
r"p/(r'^, h') for all n. Since <?" is completely mixed, so is r"; it also follows from the earlier argument 
that I'"' is consistent with r" for all n. Since converges pointwise to {a,jjL), it is easy to see 

that (r", I/") converges pointwise to {a' , n'). Thus, ^' is consistent with ct', and (it', /i') is a generalized 
sequential equilibrium of F*, as desired. The proof of the converse is similar; we leave details to the 
reader. | 

Theorem I4.3t For every extensive game F with countably many players where each player has finitely 
many pure strategies and for every possibility system IC, if{(T, is a conditional sequential equilibrium 
ofV with respect to IC, then there exists a belief system /i' such that (<?,//') is a sequential equilibrium 
ofT. 

Proof: Since (cr, /i) is a conditional sequential equilibrium of F with respect to /C, by the consistency 
of /i, cr, and /C, there exists a sequence of /C-assessments {a^,fi^) such that a'' is completely mixed, fl'' 
is consistent with and /C, and {a^^jl^) converges pointwise to (cr, ^u). Let v'^ be the belief system 
consistent with a^. Using the same techniques as in the proof of Lemma lA.ll we can construct a 
subsequence of (fi'^, v^) that converges pointwise to (a, //'). Thus, p,' is consistent with a. It remains to 
show that (cj, p') satisfies sequential rationality. 

Since, by definition of /C, for every i-information set I of F, player i has the same utility for every 
run extending a history in / — /C(/), it is not hard to show that 

EUi((a,^') I /) = C + ^'(ir(/))EU,((a,/i) I /), 

where C and ijl'{K{I)) are independent of <Ti{I). Since, by sequential rationality, crj(/) is a best re- 
sponse given /i, it is also a best response given p'. It follows that (cr, /x') is a sequential equilibrium of 
F, as desired. | 
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A.2 PROOF OF THEOREMlET] 



Theorem l5.lt If T is a standard normal-form game and sis a (pure) strategy profile such that for all 
i (z N, Si is a correlated rationalizable strategy of player i in T, then 

(i) there is a (pure) generalized Nash equilibrium s* ofT*{s) such that for every player i, s^ps^ = Sj/ 

( ii) for every (pure ) generalized Nash equilibrium s* ofT*{s}, for every local strategy s* p/ for every 
player i in s*, the strategy s^ p/ is correlated rationalizable for player i in T. 

Proof: Let T*{s) = [Q, F*", ^) be as defined in Section[5] For part (i), consider the generalized strategy 
profile s* wliere, for every player i and every F*** E Qi, i makes the same move according to both s* ^, 

and s'i. Note that, by definition of F*(s), for all h e Hf" snq have that J^(F™, h) = {T'^,-)- Thus, by 
definition of s *, for every player i, 8*^3^ = Sj. It is easy to check using the definition of F*(s), that s* 
is a generalized Nash equilibrium, and that, for all i E A^, Sj is a rationalizable strategy for player i; we 
leave details to the reader. 

For part (ii), let Dj = {s*p/ : F' e Qi}, i.e., Vi consists of the strategies in the underlying game F 
corresponding to some local strategy of player i in F*(s^. We claim that Vi C B(V^i). To see this, let 
s*p/ be any local strategy for player i in s*. Since s* is a generalized Nash equilibrium, s*p, is a best 
response to the local strategies used by other players in F'. Note that, by definition of Vi, for every other 
player j ^ i, there is a strategy Sj -p' G Vj corresponding to the local strategy p/ player j follows in 
game F'. Since, by definition of F*(s), in game F' nature makes an initial choice and then a copy of F 
is played, and all players but i know the move made by nature, this initial move by nature can be seen 
as a distribution over the local strategies used by the other players in the different copies of F contained 
in F'. Thus, it is easy to see that the strategy Sj p/ corresponding to s*p/ is in B{V^i). Finally, since 
s*p/ is an arbitrary local strategy of player i m s* , it follows that Vi C B{V^i). By the definition of 
correlated rationalizable strategies, it follows that Vi Q Si. Thus, for player imT{s) and every local 
strategy s*p, for ims*, s*p/ is correlated rationalizable for player i in F, as desired. | 
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